Generating three-dimensional virtual scene

ABSTRACT

A method and system for generating a three-dimensional (3D) virtual scene are disclosed. The method includes: identifying a two-dimensional (2D) object in a 2D picture and the position of the 2D object in the 2D picture; obtaining the three-dimensional model of the 3D object corresponding to the 2D object; calculating the corresponding position of the 3D object corresponding to the 2D object in the horizontal plane of the 3D scene according to the position of the 2D object in the picture; and simulating the falling of the model of the 3D object onto the 3D scene from a predetermined height above the 3D scene, wherein the position of the landing point the model of the 3D object in the horizontal plane is the corresponding position of the 3D object in the horizontal plane of the 3D scene.

TECHNICAL FIELD

The present invention relates to virtual world applications and, inparticular, to the creation of three-dimensional virtual scene invirtual world applications.

BACKGROUND

In applications such as virtual worlds, video games, etc., it is neededto generate a huge amount of three-dimensional virtual scenes (or “3Dscenes”). Existing technologies typically rely on the 3D graphics basedapplications to manually generate 3D scenes. Manual generation of a 3Dscene is a process in which the user configures 3D objects (i.e. virtualobjects in the 3D scene) in the 3D scene, wherein the user is requiredto select models of the 3D objects, and use input devices such as themouse to insert the selected models of the 3D objects, one by one, intothe desired position in the 3D scene.

Manual generation of 3D scenes in this way requires the user to insertmodels of 3D objects into a 3D scene one by one. Moreover, in the caseof dense 3D objects in the 3D scene, some positions are easily shieldedby existing 3D objects in the 3D scene due to the operator's angle ofview, leading to the operator's difficulty in accurately inserting amodel into a desired position.

SUMMARY

One of the objects of the present invention is to simplify the operationneeded for the user by an improved way of 3D scene generation.

In one aspect, there is provided a method for generating athree-dimensional (3D) virtual scene, comprising: identifying atwo-dimensional (2D) object in a 2D picture and the position of the 2Dobject in the 2D picture; obtaining the three-dimensional model of the3D object corresponding to the 2D object; calculating the correspondingposition of the 3D object corresponding to the 2D object in thehorizontal plane of the 3D scene according to the position of the 2Dobject in the picture; and simulating the falling of the model of the 3Dobject onto the 3D scene from a predetermined height above the 3D scene,wherein the position of the landing point of the model of the 3D objectin the horizontal plane is the corresponding position of the 3D objectin the horizontal plane of the 3D scene.

In another aspect, an apparatus is provided for generating athree-dimensional (3D) virtual scene, comprising: a 2D objectidentifying device, configured to identify a two-dimensional (2D) objectin a 2D picture and the position of the 2D object in the 2D picture; amodel acquiring device, configured to obtain the three-dimensional modelof a 3D object corresponding to the 2D object; a position mappingdevice, configured to calculate the corresponding position of the 3Dobject corresponding to the 2D object in the horizontal plane of the 3Dscene according to the position of the 2D object in the picture; and asimulation device, configured to simulate the falling of the model ofthe 3D object onto the 3D scene from a predetermined height above the 3Dscene, wherein the position of the landing point the model of the 3Dobject in the horizontal plane is the corresponding position of the 3Dobject in the horizontal plane of the 3D scene.

BRIEF DESCRIPTION OF THE DRAWINGS

In conjunction with the drawings and with reference to the followingdetailed description, features, advantages, and other aspects ofembodiments of the present invention will become more apparent from theseveral embodiments of the present invention shown in exemplary ratherthan limiting manner. In the drawings:

FIG. 1 shows a block diagram of an exemplary computing system 100adapted to be used to implement various embodiments of the presentinvention;

FIG. 2 schematically shows a tool of the prior art for manual generationof 3D scenes;

FIG. 3 is a flowchart of the method for generating a 3D scene inaccordance with an embodiment of the present invention;

FIG. 4 schematically shows several pictures showing the layout of a 3Dscene in accordance with an embodiment of the present invention;

FIG. 5 schematically shows pictures evolved from the pictures as shownin FIG. 4;

FIG. 6 schematically shows the process of putting 3D objects to a 3Dscene by manipulating pictures in accordance with an embodiment of thepresent invention; and

FIG. 7 is a block diagram of the apparatus for generating a 3D scene inaccordance with an embodiment of the present invention.

DETAILED DESCRIPTION

The flowcharts and blocks in the figures illustrate the system, methods,as well as architecture, functions and operations executable by acomputer program product according to embodiments of the presentinvention. In this regard, each block in the flowcharts or block mayrepresent a module, a program segment, or a part of code, which containsone or more executable instructions for performing specified logicfunctions. It should be noted that, in some alternative implementations,the functions noted in the blocks may also occur in a sequence differentfrom what is noted in the drawings. For example, two blocks shownconsecutively may be performed in parallel substantially or in aninverse order. This depends on relevant functions. It should also benoted that each block in the block diagrams and/or flowcharts and acombination of blocks in the block diagrams and/or flowcharts may beimplemented by a dedicated hardware-based system for performingspecified functions or operations or by a combination of dedicatedhardware and computer instructions.

Hereinafter, the principle and spirit of the present invention will bedescribed with reference to various exemplary embodiments. It should beunderstood that provision of these embodiments is only to enable thoseskilled in the art to better understand and further implement thepresent invention, not intended for limiting the scope of the presentinvention in any manner.

FIG. 1 shows a block diagram of an illustrative computing system 100that is adapted to implement embodiments of the present invention. Thecomputing system 100 shown in FIG. 1 comprises a CPU (central processingunit) 101, a RAM (random access memory) 102, a ROM (read-only memory)103, a system bus 104, an hard disk controller 105, a keyboardcontroller 106, a serial interface controller 107, a parallel interfacecontroller 108, a display controller 109, a hard disk 110, a keyboard111, a serial peripheral 112, a parallel peripheral 113 and a display114. Among these components, connected to the system bus 104 are the CPU101, the RAM 102, the ROM 103, the hard disk controller 105, thekeyboard controller 106, the serial interface controller 107, theparallel controller 108 and the display controller 109. The hard disk110 is connected to the hard disk controller 105; the keyboard 111 isconnected to the keyboard controller 106; the serial peripheral 812 isconnected to the serial interface controller 107; the parallelperipheral 113 is connected to the parallel interface controller 108;and the display 114 is connected to the display controller 109. Itshould be understood that the structural block diagram in FIG. 1 isshown only for illustration purposes, and is not intended to limit thescope of the present invention. In some cases, some devices may be addedor reduced as needed. For example, a network adapter may be configuredfor the computing system 100 so as to have the capacity of accessingcomputer networks.

Before describing various embodiments of the present invention, anexample of manually generating a three-dimensional virtual scene in theprior art is described first.

Referring to FIG. 2, a tool schematically shows manual generation of 3Dscenes.

The tool for generation of 3D scenes as shown in FIG. 2 is depicted as agraphical user interface 210. A user may operate on the graphical userinterface via an input device (not shown) to insert virtual objects intoa 3D scene.

A 3D scene, also called “virtual scene”, is a group composed of 3Dobjects. A 3D scene may also be used as the basic unit to constructanother 3D scene. For example, a number of trees as 3D objects canconstitute a 3D virtual forest. By the 3D virtual forest and a mountainas a 3D object, yet another 3D scene may be further constructed.

A 3D object is a type of virtual object in a 3D scene, such as hills,trees, rocks, lakes, boats, human figures. A 3D object can be used asthe basic unit to construct 3D scenes.

There may be a number of 3D models for a 3D object. A 3D model is athree-dimensional graphic of a 3D object, defined by a computer-readablefile, and is also called “object model” or simply “model”. 3D generatingtools already existing in the prior art, such as “3DMax”, may be used tocreate 3D models for a 3D object, and the created 3D models may be savedwithin a database. The database in which 3D models are saved is referredto as “model database”. For example, a number of three-dimensionalgraphics may be created for a 3D object “tree” and they are then storedin a model database in association with the 3D object “tree”.

Turning to FIG. 2, on the left side of the graphical user interface 210,the image denoted by the reference mark 220 shows a 3D scene.

The 3D scene 220 might be empty at the beginning. After a period of timeof editing, at the current moment as shown, the 3D scene 220 has placedtherein a number of virtual objects, for example, coconut trees 221,rocks 222 and water 223.

In the graphical user interface, there is also depicted another 3D scene230. In the 3D scene 230, a thumbnail indicated by reference mark 231shows the 3D scene 220. That is to denote that the 3D scene 220 is apart of the 3D scene 230.

On the right side of the graphical user interface 210, it is displayed alist window 240 and an image library panel 250.

The list window 240 contains a vertical scroll bar 241, a horizontalscroll bar 243 and a list of file names 242.

Each item 244 in the list of file names 242 is a file name representinga file that describes a 3D model. The user may use the mouse tomanipulate the vertical scroll bar 241 and horizontal scroll bar 243 todisplay the content of the list 242.

When the user uses the mouse pointer to point to a file name in the list242, the file name is highlighted and, at the same time, in the imagelibrary panel 250 the graphics 252 of the 3D model corresponding to thefile name is displayed.

A number of file names in the current list 242 in the list window 240represent a number of files of 3D models that describe the 3D object“tree”. The 3D models in the 3D model list 240 have been generated inadvance and stored in a 3D model database. A variety of 3D models may bestored in the 3D model database.

The graphical user interface 210 may provide an input field (not shown)for the user to input a search term so as to retrieve the desired 3Dmodel. For example, the user inputs the search term “tree”. In response,the list 242 is displayed in the list window 240. If the user moves themouse pointer over a file name 244 in the list 242, the file name ishighlighted and, at the same time, the graphics or model 252corresponding to the file name is displayed in the image library panel250, which is a coconut tree graphic. If the user wants to place themodel 252 in the 3D scene 220, the user could “select” the model 252with the mouse, “drag” it to a desired position in the 3D scene 220 andthen put place down there. In this way, a virtual object, such as thecoconut tree 221, is placed in the position.

Repeating such operation as described above, 3D models may be placed oneby one to the 3D scene 220.

After 3D models are placed in the 3D scene, adjustment may be conductedfor the 3D models in the 3D scene, such as inversion, zooming andposition moving, until the 3D scene is satisfactory.

Such a way of operation by placing virtual objects one by one into the3D scene is relatively straightforward, but it is inefficient andsometimes inconvenient. For example, in the case of dense 3D objects inthe 3D scene, some positions in the 3D scene are likely to be obstructedby existing 3D objects (such as rocks, trees) due to the operator'sangle of view. As a result, it is hard for the operator to accuratelyplace a model at a desired position.

Therefore, the invention provides a method and system for generating athree-dimensional virtual scene. Now, with reference to FIGS. 3-7,embodiments of the invention will be described in detail.

Refer first to FIG. 3, which is a flowchart of a method for generating a3D scene according to an embodiment of the invention. The flowchartbroadly describes the method of the embodiment in the following process:identifying a two-dimensional (2D) object in a 2D picture and theposition of the 2D object in the 2D picture; obtaining thethree-dimensional model of the 3D object corresponding to the 2D object;calculating the corresponding position of the 3D object corresponding tothe 2D object in the horizontal plane of the 3D scene according to theposition of the 2D object in the picture; and simulating the falling ofthe model of the 3D object onto the 3D scene from a predetermined heightabove the 3D scene, wherein the position of the landing point the modelof the 3D object in the horizontal plane is the corresponding positionof the 3D object in the horizontal plane of the 3D scene.

In one method, a simple 2D object on a two-dimensional map (alsoreferred to as a “picture” hereinafter) is used to represent a virtualobject to be placed in the 3D scene. By simulating free falling of thevirtual object, a model of the virtual object represented by a 2D objecton a picture may be placed into the 3D scene. Repeating the process ofthe above method for different pictures, more virtual objects may beplaced in the 3D scene.

Operation of each of the steps of the above process is now described byway of example.

First, at Step 310, a 2D object in a 2D picture and the position of the2D object in the 2D picture are identified.

A two-dimensional map is a picture generated by 2D graphics editingtools, and a 2D object is a two-dimensional image generated by 2Dgraphics editing tools, for example, color block, geometric shape andtext block. A picture comprises one or more 2D objects in differentpositions, and each 2D object occupies a certain region on the picture.Pictures are used to represent the layout of the three-dimensionalvirtual scene. Therefore, the term “picture” is also called the “scenelayout” or “SLM” (Scene Layout Map). FIG. 4 schematically shows severalpictures in accordance with an embodiment of the invention.

As shown in FIG. 4, according to an embodiment of the present invention,the 2D objects contained in the picture are color blocks. For example,the pictures 410 and 420 respectively contains a color block in blue 411and a color block in brown 421, and the picture 430 contains two colorblocks in red 431 and 432.

In accordance with an embodiment of the invention, for a picturecontaining a 2D object which is a color block, said identifying atwo-dimensional (2D) object in a 2D picture and the position of the 2Dobject in the 2D picture, in Step 310, comprises identifying a colorblock, the color of the color block and the position of the color block.

Those skilled in the art shall appreciate that a color block is composedof adjacent pixels of the same color. For any picture, the computer canrecognize the color of each pixel by scanning each of the pixels in thepicture. For example, by reading the pixel value of each pixel positionin the picture, the color of each pixel can be recognized. Thereby, aset of adjacent pixels having the same color may be identified, i.e. acolor block. The color of the color block is the color of each pixel inthe set. A 2D object in a two-dimensional picture can thus be identifiedto be a color block.

There are different ways in which the position of the identified 2Dobject is denoted. For example, a set of coordinates of all pixelscontained in a color block in the picture may be used to denote theposition of the color block.

In accordance with an embodiment of the invention, the coordinates (x,y) of the geometric center of the color block in the picture may becalculated to represent the coordinates of the position of the colorblock in the picture.

Taking the picture 410 as an example, by Step 310, it may be identifiedthat the picture 410 includes a blue color block 411. Assuming that thecolor block 411 contains n pixels, then a set of coordinates of thenpixels (<x1,y1>,<x2,y2>, . . . <xn,yn>) may be used to indicate theposition the color block 411; or, the coordinates <x_411,y_411> of thegeometric center of the color block 411 may be used to denote theposition of the color block 411, wherein, x_411=(x1+x2+ . . . , Xn)/n,y_411=(y1+y2+ . . . _yn)/n.

It should be noted that, if a picture contains multiple color blocks,Step 310 may also identify the multiple color blocks and the color andthe position of each of the color blocks.

The pictures shown in FIG. 4 may be generated using a picture editor 772(FIG. 7). One example of such a picture editor is the drawing tool“MSPAINT provided by the Windows® operating system. MSPAINT providessuch editing features as drawing a picture with a “brush” according toselected shape and size, and filling an area with a color. With theediting features provided by the drawing tool, color blocks 411,421,431,etc., may be drawn in a blank screen to result in the pictures as shownin FIG. 4.

In accordance with an embodiment of the invention, the picture asmentioned in Step 310 may be obtained directly from the output of thepicture editor.

Of course, after a picture is created with the picture editor, thecreated picture may be stored in the format of a drawing file (such as afile with the suffix “.bmp”) , for example, in a picture database 781(FIG. 7). Accordingly, an embodiment of the invention may comprisereading from such a database (e.g., the picture database 781) a drawingfile describing a picture, thereby obtaining the picture mentioned inStep 310.

According to an embodiment of the present invention, in implementing theinvention, it is needed to repeatedly receive a plurality of pictures.In that case, it is needed to pre-set the sequential relationship amongthe pictures. For example, a number of file names of two-dimensionalpictures are set in a list in accordance with a predetermined sequence.In the repeated execution of Step 310, the file names may be obtainedfrom the list sequentially and then the drawing files are read with theobtained file names from the storage.

In the above description, it is assumed that the 2D objects contained inthe pictures (for example, 410, 420 and 430) are color blocks. However,the invention is not limited to that. The 2D objects contained in apicture of the invention may be any graphics that can be individuallyrecognized.

For example, the 2D object contained in the picture, in addition tocolor block, may also be geometric graphics or a block of text.

For example, the color block 411 in the picture 410 may be replaced witha pentagon 411 a. The color block 421 in the picture 420 may be replacedwith an oval 421 a. And the color blocks 431 and 432 in the picture 430may be respectively replaced with triangles 431 a and 432 a. Those inskilled in the art shall appreciate that such geometric graphics andcolor blocks contained in the picture and their position are allindividually identifiable. For example, in Step 310, it may beidentified that there is a pentagon included in the picture 410.

As another example, the color block 411 in the picture 410 may bereplaced with a text block 411 b. Those in skilled in the art shallappreciate that such geometric graphics and text blocks, and theirposition, are also individually identifiable. For example, in Step 310,it may be identified that there is a rectangular block containing thetext content of “lake” in the picture 410. The color blocks 421, 431 and432 may also be replaced with similar text blocks.

Generally, if the result of the execution of Step 310 is theidentification of m 2D objects and their positions, the result may beexpressed as a list of tuples

(<OBJ1,POS1>,<OBJ2,POS2> . . . <OBJm,POSm>)   (1)

wherein m denotes the number of 2D objects identified, and OBJi and POSi(i=1,2 . . . m) respectively represent a 2D object and its position.Each position may further be denoted by two-dimensional coordinates.

For example, for the picture 410, the result of executing Step 310 isOBJ1=“blue color block”, POS1=<x_411,y_411>, wherein <x_411,y_411> isthe coordinates of the color block 411 in the picture 410. For thepicture 420, the result of executing Step 310 is OBJ1=“brown colorblock”, POS1=<x_421,y_421>. And for the picture 430, the result ofexecuting Step 310 is OBJ1=“red color block”, POS1=<x_431,y_431>;OBJ2=“red color block”, POS2=<x_432,y_432>.

Turning to FIG. 3, description is continued on subsequent stepsfollowing the Step 310.

To facilitate illustration, unless specifically provided, the picture410 shown in FIG. 4 will be taken as the example of the picture in thefollowing description of the subsequent steps. As described above, forthe picture 410, the result of the execution of Step 310 is OBJ1=“bluecolor block”, POS1=<x_411,y_411>.

In Step 320, the three-dimensional model of the 3D object correspondingto the 2D object is obtained.

In accordance with an embodiment of the invention, the 3D objectcorresponding to the 2D object may be determined according to apredefined mapping relationship between 2D objects and 3D objects.

In accordance with an embodiment of the invention, in the case of the 2Dobject being a color block, the 3D object corresponding to a color blockmay be determined according to a predefined mapping relationship betweencolors of color blocks and 3D objects.

For example, the mapping relationship may be set in advance betweencolors of the color blocks and 3D objects, creating the followingcolor-3D object mapping table (2):

{<blue, lake>, <brown, boat, . . . <red, human character>}  (2)

wherein the two-tuple <blue, lake> denotes that “blue” corresponds to 3Dobject “lake”. Similarly, the mapping table (2) also shows that “brown”corresponds to 3D object “boat” . . . and “red” corresponds to 3D object“human character”.

For example, in Step 310, the 2D object in the picture 410 is recognizedto be blue color block 411. According to the mapping table (2), it maybe determined that the 3D object corresponding to the color block 411 is“lake”. Similarly, it may be determined that the 3D object correspondingto the color block 421 in FIG. 4 is a “boat”, and the 3D objectscorresponding to the color blocks 431 and 432 are “human characters”.

After the 3D object corresponding to the 2D object is determined, themodel of the 3D object may be further identified. Typically, for a 3Dobject, there are often a plurality of corresponding models. Forexample, the 3D object “tree” shown in FIG. 2 may have multiple modelsto represent different species and/or appearance. The models of a 3Dobject may be individually created in advance and stored in a modeldatabase 785 (FIG. 7).

One or more models are automatically retrieved from a model database 785based on the determined 3D object. This operation may be implemented ina way similar to that shown in FIG. 2. For example, a list window and animage library panel similar to the list window 240 and the image librarypanel 250 respectively may be displayed to the user, and in the listwindow one or more file names of models and their correspondingthree-dimensional graphics are displayed for the user to determine. Inresponse to the user's selection, a model is determined to be the modelof 3D object corresponding to the 2D object model.

For example, after it is determined that the 3D object corresponding tothe color block 411 is “lake”, then a model representing “lake” may bedetermined in the above manner.

The result of the execution of Steps 310 and 320 for the picture 410 isshown in FIG. 5, wherein the reference mark 511 denotes the model of the3D object “lake” corresponding to the color block 411.

Of course, if the 2D object contained in the picture 410 is the pentagon411 a or the text block 411 b, the model 511 of the 3D object “lake” mayalso be obtained in the same way. If Steps 310 and 320 are executed forthe pictures 420 and 430, then the model 521 of the 3D object “boat”corresponding to the color block 421 in the picture 420 as well as themodel 531 and 532 the 3D objects “human character” respectivelycorresponding to the 2D objects 431 and 432 in the picture 430 may beobtained. The model 531 and the model 532 may be the same, or they maynot be the same, which can be determined by the user.

It should be noted that, although it is noted above that the model ofthe 3D object may be determined, after the 3D object corresponding tothe 2D object is determined, in a way similar to that shown in FIG. 2;compared to the manner shown in FIG. 2, with the present invention,there is no need for the user to manually enter the search term forsearch the model database.

And, as those skilled in the art shall appreciate, other methods mayalso be used to determine the model of the 3D object after the 3D objectcorresponding to the 2D object is determined.

It is also to be noted that the 2D object-3D object mapping table (2)described above is for the situation that the 2D object is a colorblock. For 2D objects of other forms, e.g. geometric graphics (e.g., 411a, 421 a, 431 a, 432 a in FIG. 4) and text blocks (e.g., 411 b), themapping relationship between the 2D objects and the 3D objects may alsobe defined in advance in a similar way. For example, for the geometricgraphics, the 2D object-3D object mapping table (3) may be defined inadvance as the following:

{<pentagon, lake>,<oval, boat>, . . . <triangular, humancharacters>}  (3)

Accordingly, those skilled in the art, when implementing the invention,may define this kind of relationship in accordance with their practiceand choice.

In Step 330, the corresponding position of the 3D object correspondingto the 2D object in the horizontal plane of the 3D scene is calculatedaccording to the position of the 2D object in the picture.

According to an embodiment of the invention, the coordinates of theposition of the 3D object corresponding to the 2D object in thehorizontal plane of the 3D scene may be calculated from the coordinatesof the position of the 2D object in the picture based on the mappingrelationship between the picture and an area of the horizontal plane ofa 3D scene.

The mapping relationship between the picture and the horizontal surfacearea of and the 3D scene is defined in advance. For example, the picture410 is a rectangle ABCD, and there is a pre-defined relationship betweenthe picture 410 and the area of the horizontal plane of the 3D scenedenoted by the reference mark 600. Specifically, the four pointsconstituting the rectangle of the picture 410, namely, A, B, C and D aremapped to four points A ‘, B’, C ‘and D’ in the horizontal plane of the3D scene 600. The four points form a region 640, which is the regionformed when the picture 410 is projected to the 3D scene 600.

As it will be described later with reference to FIG. 7, the mappingrelationship between the picture and the horizontal region of the 3Dscene may be stored in a mapping relationship database 783.

Based on the mapping relationship between the pictures 410 and thehorizontal region 640 of the 3D scene 600, the point on the horizontalregion 640 of the 3D scene 600 corresponding to a point of the picturemay be derived.

Since the coordinates <x_411,y_411> of the position of the 2D object 411in the picture 410 have been determined in Step 310, the proportionalrelationship between the picture 410 and the horizontal region 640 maybe calculated according to the mapping relationship between the picture410 and the horizontal region 640 of the 3D scene 600, and thecoordinates <x_411′,y_411′> in the horizontal plane of the 3D scene 600corresponding to the coordinates <x_411,y_411> may be calculated. Thecalculated coordinates are the coordinates of the position of the 3Dobject corresponding to the 2D object 411 in the horizontal plane of thescene 600.

Similarly, the coordinates <x_421′,y_421′> of the position of the 3Dobject corresponding to the 2D object 421 in the picture 420 in thehorizontal plane of the scene 600 may be calculated. The coordinates ofthe positions of the 3D objects corresponding to the 2D objects 431 and432 in the picture 430 in the horizontal plane of the scene 600 are<x_431′,y_431′> and <x_432′,y_432′>, respectively.

The operation of Step 320 and Step 330 of the method shown in FIG. 3 isdescribed above. It should be noted that the execution of Step 320 andStep 330 is not restricted to a specific precedence relationship; inother words, Step 330 may be performed before Step 320 or vice versa, orthe two steps may be performed simultaneously.

After the above steps, the process proceeds to Step 340.

In Step 340, the falling of the model of the 3D object onto the 3D scenefrom a predetermined height above the 3D scene is simulated, wherein theposition of the landing point of the model of the 3D object in thehorizontal plane is the corresponding position of the 3D object in thehorizontal plane of the 3D scene.

According to an embodiment of the present invention, said simulating thefalling of the model of the 3D object onto the 3D scene from apredetermined height above the 3D scene comprises simulating the modelof the 3D object to remain on the virtual object in the 3D scene whichcollided during the falling.

According to an embodiment of the present invention, said predeterminedheight is a predetermined height associated with the picture. That is,different pictures may be associated with different predeterminedheights.

As shown in FIG. 6, assume that initially the 3D scene 600 in which 3Dobject models are to be placed 600 is only blank ground. At this time,it is to simulate the falling of the model of the 3D objectcorresponding to the 2D object in the picture 410 from a predeterminedheight above the 3D scene.

Previously, at Step 310, it is identified that there is only one 2Dobject 411 in the picture 410. In Step 320, the model 511 of the 3Dobject “lake” corresponding to the 2D object 411 is obtained. And inStep 330, the position of the 3D object “lake” corresponding to the 2Dobject 411 in the horizontal plane of the 3D scene 600, e.g., thecoordinates <x_411′,y_411′>, is calculated.

Therefore, Step 340 simulates the falling or landing process of themodel 511 of the 3D object “lake” to cause the model 511 to land on the3D scene 600, so that the 3D scene 600 becomes the 3D scene 600A. In theprocess, the model 511 of the 3D object “lake” falls onto the blankground and is rendered as a three-dimensional graphic 611, and theposition of its landing point in the horizontal plane is the position ofthe 3D object “lake” in the horizontal plane of the 3D scene 600 ascalculated in Step 330, e.g., the coordinates <x_411′,y_411′>.

Subsequent to the execution of Steps 310-340 for the picture 410, Steps310-340 are performed for the picture 420. In Step 310, it is identifiedthat there is only one 2D object 421 in the picture 420. In Step 320,the model 521 of the 3D object “boat” corresponding to the 2D object 421is obtained. And in Step 330, the position of the 3D object “boat”corresponding to the 2D object 421 in the horizontal plane of the 3Dscene 600, e.g., the coordinates <x_421′,y_421′>, is calculated.

In Step 340, the falling or landing process of the model 521 of the 3Dobject “boat” is simulated to cause the model 521 to land on the 3Dscene 600A, wherein the 3D object “boat” is landed onto thethree-dimensional graphic “lake” is rendered as a three-dimensionalgraphic 621, and the position of its landing point in the horizontalplane is the position of the 3D object “boat” in the horizontal plane ofthe 3D scene 600 as calculated in Step 330, e.g., the coordinates<x_421′,y_421′>. After the completion of Step 340, the 3D scene 600Abecomes the 3D scene 600B.

Subsequent to the execution of Steps 310-340 for the picture 420, Steps310-340 are performed for the picture 430. In Step 310, it is identifiedthat there are two 2D objects 431 and 432 in the picture 430.

In Step 320, the models 531 and 532 of the 3D objects “human character”corresponding to the 2D objects 431 are obtained. And in Step 330, theposition of the 3D objects “ human character ” corresponding to the 2Dobjects 431 and 432 in the horizontal plane of the 3D scene 600, e.g.,the coordinates <x_431′,y_431′>and <x_432′,y_432′>, are calculated.

In Step 340, the falling or landing process of the models 531 and 532 ofthe 3D object “human character” is simulated to cause the models 531 and532 to land on the 3D scene 600B, wherein the model 531 of the 3D object“human character” lands onto the three-dimensional graphics 611 of“lake” and is rendered as a three-dimensional graphic 631, and theposition of its landing point in the horizontal plane is the position ofthe 3D object “ human character ” in the horizontal plane of the 3Dscene 600 as calculated in Step 330, e.g., the coordinates<x_431′,y_431′>. The model 532 of the 3D object “human character”corresponding to the 2D object 432 is landed onto the three-dimensionalgraphics 621 of “boat” and is rendered as a three-dimensional graphics632, and the coordinates of the position of its landing point in thehorizontal plane is <x_431′,y_431′>. After the completion of Step 340,the 3D scene 600A becomes the 3D scene 600B.

It should be noted that the model 531 and 532 of the 3D objects “humancharacter” corresponding respectively to the 2D objects 431 and 432 maybe identical or may not be identical. As mentioned in the description ofStep 330, the different styles of the model 531 and model 532 may bedetermined in response to the user's selection.

After the completion of Step 340, the 3D scene 600B becomes 3D scene600C.

From the above, it may be seen that a complex three-dimensional virtualscene may be created by repeating the above process for differentpictures according to a certain order.

In implementing the invention, during the process of the 3D scene 600being evolved to the 3D scene 600A, 600B and 600C, the position,direction and size of the virtual objects in the 3D scene 600A, 600B and600C may be adjusted at any time. And the 3D scene 600A, 600B and 600Cmay also be saved in the 3D scene database 787 (FIG. 7) in the form ofimage files. Such applications like the virtual world application 790(FIG. 7) may read these image files from the 3D scene database 787 anddisplay the corresponding 3D scenes in a three-dimensional virtualsystem.

The method for generating a three-dimensional virtual scene according tovarious embodiments of the invention has been described. According tothe inventive concepts, the invention also provides a system forgenerating a three-dimensional virtual scene.

FIG. 7 schematically shows a block diagram of the system 700 forgenerating a three-dimensional virtual scene in accordance with anembodiment of the invention.

As shown in the FIG. 7, the system 700 comprises a 2D object identifyingdevice 710, a model acquiring device 720, a position mapping means 730,and a simulation device 740.

The 2D object identifying device 710 is configured to recognize/identifya two-dimensional object in a 2D picture and the position of the 2Dobject in the 2D picture.

The model acquiring means 720 is configured to obtain thethree-dimensional model of a 3D object corresponding to the 2D object.

The position mapping means 730 is configured to calculate thecorresponding position of the 3D object corresponding to the 2D objectin the horizontal plane of the 3D scene according to the position of the2D object in the picture.

The simulation device 740 is configured to simulate the falling of themodel of the 3D object onto the 3D scene from a predetermined heightabove the 3D scene, wherein the position of the landing point the modelof the 3D object in the horizontal plane is the corresponding positionof the 3D object in the horizontal plane of the 3D scene.

In accordance with an embodiment of the invention, the model acquiringdevice 730 is further configured to determine the 3D objectcorresponding to the 2D object according to a predefined mappingrelationship between 2D objects and 3D objects.

As indicated in the description of the method Step 330 in connectionwith FIG. 3 in the above, the predefined 2D object-3D object mappingrelationship may be stored in a mapping relationship DB (database) 783.The model acquiring device 730 may read the 2D object-3D object mappingrelationship from the mapping relationship DB 783.

In accordance with an embodiment of the present invention, the modelacquiring device 730 is further configured to retrieve one or moremodels from a model database based on the determined 3D objectcorresponding to the 2D object, and determine a model of the 3D objectcorresponding to the 2D object in response to a user's selection.

According to an embodiment of the invention, the position mapping device720 is further configured to calculate the coordinates of the positionof the 3D object corresponding to the 2D object in the horizontal planeof the 3D scene from the coordinates of the position of the 2D object inthe picture based on the mapping relationship between the picture and anarea of the horizontal plane of the 3D scene.

The mapping relationship between the picture and the area or region ofthe horizontal plane of the 3D scene is established in advance. Forexample, the mapping relationship between the picture and the area orregion of the horizontal plane of the 3D scene may be established by amapping relationship setting device 774, and data of the mappingrelationship may be stored in a database, e.g., the mapping relationshipdatabase 783 shown in the FIG. 7. The position mapping device may readthe mapping relationship between the picture and the area or region ofthe horizontal plane of the 3D scene from the mapping relationshipdatabase 783.

According to an embodiment of the invention, the 2D object in thepicture mentioned in the above is a color block.

Accordingly, according to an embodiment of the invention, the 2D objectidentifying device is further configured to identify a color block, andthe color and the position of the color block; and the model acquiringdevice is further configured to determine the 3D object corresponding tothe 2D object based on the predefined color-3D object mappingrelationship.

Similarly, the color-3D object mapping relationship may be defined by amapping relationship setting device 774 in advance, and data of thecolor-3D object mapping relationship may be stored in the mappingrelationship database 783. The 2D object identifying device 710 may readthe data of the color-3D object mapping relationship from mappingrelationship database 783 according to needs.

In accordance with an embodiment of the present invention, the 2D objectidentifying device is further configured to calculate the coordinates ofthe geometric center of the color block in the picture to represent thecoordinates of the position of the color block in the picture.

In accordance with an embodiment of the invention, the simulation device740 is further configured to simulate the model of the 3D object toremain on the virtual object in the 3D scene collided during thefalling.

In accordance with an embodiment of the invention, the predefined heightis a height in association with the picture.

In accordance with an embodiment of the invention, the picture may becreated in advance by a tool for generating 2D pictures such as thepicture editor 772, and the created picture may be stored in a picturedatabase 781. In implementing the invention, a picture inputting device750 may be employed to read pictures from the picture editor 772 or thepicture database 781 as the input data of the 2D object identifyingdevice 710.

The above has described on the system for generating three-dimensionalvirtual scene according to embodiments of the present invention. Becausethe method for generating three-dimensional virtual scene according toembodiments of the present invention has been described in detail, inthe above, the description of the system omits the content that repeatsor may readily be derived from the description of the method.

It should be noted that the above depiction is only exemplary, notintended for limiting the present invention. In other embodiments of thepresent invention, this method may have more, or less, or differentsteps, and numbering the steps is only for making the depiction moreconcise and much clearer, but not for stringently limiting the sequencebetween each steps, while the sequence of steps may be different fromthe depiction.

Therefore, in some embodiments, the above one or more optional steps maybe omitted.

Specific embodiments of each step may be different from the depiction.All these variations fall within the spirit and scope of the presentinvention.

The present invention may adopt a form of hardware embodiment, softwareembodiment or an embodiment comprising hardware components and softwarecomponents. In a preferred embodiment, the present invention isimplemented as software, including, without limitation to, firmware,resident software, micro-code, etc.

Moreover, the present invention may be implemented as a computer programproduct usable from computers or accessible by computer-readable mediathat provide program code for use by or in connection with a computer orany instruction executing system. For the purpose of description, acomputer-usable or computer-readable medium may be any tangible meansthat can contain, store, communicate, propagate, or transport theprogram for use by or in connection with an instruction executionsystem, apparatus, or device.

The medium may be an electric, magnetic, optical, electromagnetic,infrared, or semiconductor system (apparatus or device), or propagationmedium. Examples of the computer-readable medium would include thefollowing: a semiconductor or solid storage device, a magnetic tape, aportable computer diskette, a random access memory (RAM), a read-onlymemory (ROM), a hard disk, and an optical disk. Examples of the currentoptical disk include a compact disk read-only memory (CD-ROM), compactdisk-read/write (CR-ROM), and DVD.

A data processing system adapted for storing or executing program codewould include at least one processor that is coupled to a memory elementdirectly or via a system bus. The memory element may include a localmemory usable during actually executing the program code, a mass memory,and a cache that provides temporary storage for at least one portion ofprogram code so as to decrease the number of times for retrieving codefrom the mass memory during execution.

An Input/Output or I/O device (including, without limitation to, akeyboard, a display, a pointing device, etc.) may be coupled to thesystem directly or via an intermediate I/O controller.

It is to be understood from the foregoing description that modificationsand alterations may be made to the respective embodiments of the presentinvention without departing from the true spirit of the presentinvention. The description in the present specification is intended tobe illustrative and not limiting. The scope of the present invention islimited by the appended claims only.

It is to be understood from the foregoing description that modificationsand alterations may be made to the respective embodiments of the presentinvention without departing from the true spirit of the presentinvention. The description in the present specification is intended tobe illustrative and not limiting. The scope of the present invention islimited by the appended claims only.

1. A method for generating a three-dimensional (3D) virtual scene,comprising: identifying a two-dimensional (2D) object in a 2D pictureand a position of the 2D object in the 2D picture; obtaining athree-dimensional model of a 3D object corresponding to the 2D object;calculating a corresponding position of the 3D object corresponding tothe 2D object in a horizontal plane of the 3D scene according to theposition of the 2D object in the picture; and simulating a falling ofthe model of the 3D object onto the 3D scene from a predetermined heightabove the 3D scene, wherein the position of the landing point the modelof the 3D object in the horizontal plane is the corresponding positionof the 3D object in the horizontal plane of the 3D scene.
 2. The methodaccording to claim 1, wherein said obtaining the three-dimensional modelof the 3D object corresponding to the 2D object further comprises:determining the 3D object corresponding to the 2D object according to apredefined mapping relationship between 2D objects and 3D objects. 3.The method according to claim 2, wherein said obtaining thethree-dimensional model of the 3D object corresponding to the 2D objectfurther comprises: retrieving one or more models from a model databasebased on the determined 3D object corresponding to the 2D object, anddetermining a model of the 3D object corresponding to the 2D object inresponse to a user's selection.
 4. The method according to claim 1,wherein said calculating the corresponding position of the 3D objectcorresponding to the 2D object in the horizontal plane of the 3D sceneaccording to the position of the 2D object in the picture furthercomprises: calculating the coordinates of the position of the 3D objectcorresponding to the 2D object in the horizontal plane of the 3D scenefrom coordinates of the position of the 2D object in the picture basedon the mapping relationship between the picture and an area of thehorizontal plane of the 3D scene.
 5. The method according to claim 1,wherein the 2D object in the picture is a color block.
 6. The methodaccording to claim 5, wherein said identifying a two-dimensional (2D)object in a 2D picture and the position of the 2D object in the 2Dpicture further comprises: identifying a color block, a color and aposition of the color block; and said obtaining the three-dimensionalmodel of the 3D object corresponding to the 2D object, furthercomprises: determining the 3D object corresponding to the 2D objectbased on the predefined color-3D object mapping relationship.
 7. Themethod according to claim 6, wherein said identifying a color block, acolor and a position of the color block further comprises: calculatingthe coordinates of a geometric center of the color block in the pictureto represent coordinates of the position of the color block in thepicture.
 8. The method according to claim 1, wherein said simulating afalling of the model of the 3D object onto the 3D scene from apredetermined height above the 3D scene comprises simulating the modelof the 3D object to remain on the virtual object in the 3D sceneencountered during the falling.
 9. The method according to claim 1,wherein said predefined height is a height associated with the picture.10. The method according to claim 1, wherein said picture is generatedin advance using a tool for generating 2D pictures.
 11. A system forgenerating a three-dimensional (3D) virtual scene, comprising: a 2Dobject identifying device, configured to identify a two-dimensional (2D)object in a 2D picture and a position of the 2D object in the 2Dpicture; a model acquiring device, configured to obtain athree-dimensional model of a 3D object corresponding to the 2D object; aposition mapping device, configured to calculate a correspondingposition of the 3D object corresponding to the 2D object in a horizontalplane of the 3D scene according to the position of the 2D object in thepicture; and a simulation device, configured to simulate a falling ofthe model of the 3D object onto the 3D scene from a predetermined heightabove the 3D scene, wherein the position of a landing point of the modelof the 3D object in the horizontal plane is a corresponding position ofthe 3D object in the horizontal plane of the 3D scene.
 12. The systemaccording to claim 11, wherein the model acquiring device is furtherconfigured to determine the 3D object corresponding to the 2D objectaccording to a predefined mapping relationship between 2D objects and 3Dobjects.
 13. The system according to claim 12, wherein the modelacquiring device is further configured to retrieve one or more modelsfrom a model database based on the determined 3D object corresponding tothe 2D object, and determine a model of the 3D object corresponding tothe 2D object in response to a user's selection.
 14. The systemaccording to claim 11, wherein said position mapping device is furtherconfigured to calculate the coordinates of the position of the 3D objectcorresponding to the 2D object in the horizontal plane of the 3D scenefrom the coordinates of the position of the 2D object in the picturebased on the mapping relationship between the picture and an area of thehorizontal plane of the 3D scene.
 15. The system according to claim 11,wherein the 2D object in the picture is a color block.
 16. The systemaccording to claim 15, wherein the 2D object identifying device isfurther configured to identify a color block, and a color and a positionof the color block; and the model acquiring device is further configuredto determine the 3D object corresponding to the 2D object based on thepredefined color-3D object mapping relationship.
 17. The systemaccording to claim 16, wherein the 2D object identifying device isfurther configured to calculate coordinates of the geometric center ofthe color block in the picture to represent the coordinates of theposition of the color block in the picture.
 18. The system according toclaim 11, wherein the simulation device is configured to simulate themodel of the 3D object to remain on the virtual object in the 3D sceneencountered during the falling.
 19. The system according to claim 11,wherein the predefined height is a height in association with thepicture.
 20. The system according to claim 11, wherein the picture isgenerated in advance using a tool for generating 2D pictures.